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ABSTRACT 

In a data processing system that executes a program of instructions, a method of inverting 
a distorted surface in a detail-in-context presentation is provided comprising the steps of 
locating a first approximation point in an undistorted surface for the inversion of a point 
in a distorted surface, determining if the approximation point is acceptable as an 
inversion of the point in the distorted surface, locating a next approximation point in the 
undistorted surface if the first approximation point is not acceptable, and repeating this 
process until an acceptable approximation point is located for the inversion of the point in 
the distorted surface. The use of this method to obtain the distance between points on an 
undistorted surface from the relative distances between corresponding points on a 
plurality of distorted surfaces in a detail-in-context presentation is provided. A data 
processing system for the inversion of detail-in-context presentations is provided 
including an input device, a central processing unit, memory, and a display wherein said 
data processing system has stored therein data representing sequences of instructions 
which when executed cause the method described to be performed. 
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A METHOD AND SYSTEM FOR INVERSION OF DETAIL-IN-CONTEXT 

PRESENTATIONS 

The invention relates to the field of computer graphics processing. More specifically, the 
invention relates to detail-in-context presentations and the inversion of distortions in 
5 detail-in-context presentations. 

BACKGROUND OF THE INVENTION 

Since the advent of video display terminals as the primary interface to the computer, 
making the best use of the available screen space has been a fundamental issue in user 

10 interface design. This issue has been referred to as the "screen real estate problem". The 
necessity for effective solutions to this problem is growing as the ability to produce and 
store visual information in great volumes is outstripping the rate at which display 
technology is advancing. One solution to the screen real estate problem is the use of 
detail-in-context presentation techniques. Detail-in-context presentations are useful for 

1 5 displaying large amounts of information on limited-size computer screens. 

Now, in the detail-in-context discourse, differentiation is often made between the terms 
Representation" and "presentation". A representation is a formal system, or mapping, for 
specifying raw information or data that is stored in a computer or data processing system. 
For example, a digital map of a city is a representation of raw data including street names 
20 and the relative geographic location of streets and utilities. Such a representation may be 
displayed visually on computer screen or printed on paper. On the other hand, a 
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presentation is a spatial organization of a given representation that is appropriate for the 
task at hand. Thus, a presentation of a representation organizes such things as the point of 
view and the relative emphasis of different parts or regions of the representation. For 
example, a digital map of a city may be presented with a work route magnified to reveal 

5 street names. Thus, detail-in-context presentations allow for magnification of a particular 
region of interest (the "focal region") in a representation while preserving visibility of 
the surrounding representation. In other words, in detail-in-context presentations focal 
regions are presented with an increased level of detail without the removal of contextual 
information from the original representation. In general, a detail-in-context presentation 

10 may be considered as a distorted view (or distortion) of a portion of the original 
representation where the distortion is the result of the application of a "lens" like 
distortion function to the original representation. For reference, a detailed review of 
various detail-in-context presentation techniques may be found in Carpendale's A 
Framework for Elastic Presentation Space (Carpendale, Marianne S. T., A Framework 

15 for Elastic Presentation Space (Burnaby, British Columbia: Simon Fraser University, 
1999)). 

One shortcoming of the prior art detail-in-context presentation methods is their inability 
to effectively invert distortions in a detail-in-context presentation back to an original or 
undistorted presentation of the representation. The ability to perform such an inversion or 
20 inverse mapping would be of great value in extending the capabilities of detail-in-context 
presentations to applications such as image editing. For example, the editing of a focal 
region in a representation may be facilitated more easily in a distorted presentation rather 
than in an undistorted presentation. 
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The ability to perform an inverse mapping is also necessary for applications involving the 
subsequent distortion of a previously distorted presentation. In other words, inversion 
would allow a presentation system user to accurately position or reposition one or more 
distortion producing 'lenses" within a given presentation that has already been distorted. 

5 Hence, the distorted presentation ultimately viewed by the user may be the end result of a 
series of distortion steps wherein the individual distortion steps are not known or are 
difficult to invert. In fact, the need for inversion arises whenever it is necessary to 
position a lens based on observed coordinates in the distorted presentation. This is so 
because the lens may be directly generated only from coordinate information in the 

10 undistorted presentation. As such, an inversion is necessary to produce the source 
coordinates for generating the lens. 

Moreover, inversion provides a means to calculate real distances in an undistorted 
presentation based on locations within one or more lenses in a corresponding distorted 
presentation. For example, if a user wants to know the distance in the undistorted 
15 presentation between the focal points of two separate lenses in a corresponding distorted 
presentation of a map, such as the distance between a current location and a destination 
location, this distance can be computed via inversions of the focal points of these lenses. 

Several systems are known which provide techniques for converting distorted or warped 
three-dimensional (3D) images into corrected, undistorted, or dewarped two-dimensional 
20 (2D) images. In United States Patent Number 6,005,611 (Gullichsen, et al.), a system is 
disclosed wherein a distorted image captured by a wide-angle or fisheye lens is corrected 
through the use of a specially generated polynomial transform function that maps points 
from the distorted image into rectangular points. A more complex transform function is 
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described in United States Patent Number 5,185,667 (Zimmerman). In United States 
Patent Number 5,329,310 (Liljegem, et al.) a similar objective is achieved in the context 
of motion picture images through the use of multiple lens (camera and projector) transfer 
functions. The result being the ability to project an image, taken from a particular point of 

5 view, onto a screen, especially a curved wide angle screen, from a different point of view, 
to be viewed from the original point of view, without distortion. In United States Patent 
Number 5,175,808 (Sayre), a method and apparatus for non-affine image warping is 
disclosed that uses displacement tables to represent the movement of each pixel from an 
original location in a source image to a new location in a warped destination image. 

1 0 Through these displacement tables and a resampling method, the need for inversion of the 
underlying transform equation that specify the distortion or warp is eliminated. Finally, in 
United States Patent Number 4,985,849 (Hideaki), look-up tables are used in combination 
with the forward evaluation of the transform equation in order to avoid the step of 
transform equation inversion. However, none of these systems disclose a method and 

15 system for inverting distortions in a manner that is optimized for detail-in-context 
presentations. 

A need therefore exists for a method and system that will allow for the effective inversion 
of distortions in detail-in-context presentations. Therefore, it is an object of the present 
invention to obviate or mitigate at least some of the above mentioned disadvantages. 

20 
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SUMMARY OF THE INVENTION 

The invention provides a method and system for the inversion of distortions in detail-in- 
context presentations. According to one aspect of the invention, a method is provided that 
allows a distortion in a detail-in-context presentation to be inverted. The method 
5 comprises the steps of locating a first approximation point in an undistorted surface for 
the inversion of a point in a distorted surface, determining if the approximation point is 
acceptable as an inversion of the point in the distorted surface, locating a next 
approximation point in the undistorted surface if the first approximation point is not 
acceptable, and repeating this process until an acceptable approximation point is located 

10 for the inversion of the point in the distorted surface. According to another aspect of the 
invention, the use of this method to obtain the distance between points on an undistorted 
surface from the relative distances between corresponding points on a plurality of 
distorted surfaces in a detail-in-context presentation is provided. According to another 
aspect of the invention, a data processing system is provided. This data processing system 

1 S has stored therein data representing sequences of instructions which when executed cause 
the above-described method to be performed The data processing system generally has 
an input device, a central processing unit, memory, and a display. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 The invention may best be understood by referring to the following description and 
accompanying drawings which illustrate the invention. In the drawings: 
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FIG. 1 is a cross-sectional view of a presentation illustrating a point X on a distorted 
surface and a first approximation point P 0 for its inversion back to an original basal plane 
in accordance with the preferred embodiment; 

FIG. 2 is a cross-sectional view of a presentation illustrating the displacement of a first 
5 approximation point P 0 onto a distorted surface by application of a distortion function D 
resulting in a point P 0 D in accordance with the preferred embodiment; 

FIG. 3 is a cross-sectional view of a presentation illustrating the projection of a point P 0 D 
onto a line RVP-X resulting in a point P 0 P in accordance with the preferred embodiment; 

FIG. 4 is a cross-sectional view of a presentation illustrating the projection of a point P 0 P 
10 onto a basal plane resulting in a second approximation point Pi and a corresponding 
displaced point Pi D in accordance with the preferred embodiment; 

FIG. 5 is a cross-sectional view of a presentation illustrating the projection of a point Pi D 
onto a line RVP-X resulting in a point Pi P which is then projected onto a basal plane 
resulting in a third approximation point P2 in accordance with the preferred embodiment; 

15 FIG. 6 is a block diagram of a data processing system in accordance with the preferred 
embodiment; 

FIG. 7 is a flow chart illustrating an iterative method for inversion in accordance with the 
preferred embodiment. 



20 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following description, numerous specific details are set forth to provide a thorough 
understanding of the invention. However, it is understood that the invention may be 
practiced without these specific details. In other instances, well-known software, circuits, 
5 structures and techniques have not been described or shown in detail in order not to 
obscure the invention. The term data processing system is used herein to refer to any 
machine for processing data, including the computer systems and network arrangements 
described herein. The term "Elastic Presentation Space" or "EPS*' is used herein to refer 
to techniques that allow for the adjustment of a visual presentation without interfering 

10 with the information content of the representation. The adjective "elastic" is included in 
the term as it implies the capability of stretching and deformation and subsequent return 
to an original shape. EPS graphics technology is described by Carpendale in A 
Framework for Elastic Presentation Space (Carpendale, Marianne S. T., A Framework 
for Elastic Presentation Space (Burnaby, British Columbia: Simon Fraser University, 

1 5 1999)) which is incorporated herein by reference. Basically, in EPS graphics technology, 
a two-dimensional visual representation is placed onto a surface; this surface is placed in 
three-dimensional space; the surface, containing the representation, is viewed through 
perspective projection; and the surface is manipulated to effect the reorganization of 
image details. The presentation transformation is separated into two steps: surface 

20 manipulation or distortion and perspective projection. 

In general, the invention described herein provides a method and system for the inversion 
of distortions in detail-in-context presentations. The method and system described is 
applicable to detail-in-context navigation within computer graphics processing systems 
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including EPS graphics technology and to computer graphics processing systems in 
general. 

According to one aspect of the invention, a method is described that allows a distortion in 
a detail-in-context presentation to be inverted. The method comprises the steps of 
5 locating a first approximation point in an undistorted surface for the inversion of a point 
in a distorted surface, determining if the approximation point is acceptable as an 
inversion of the point in the distorted surface, locating a next approximation point in the 
undistorted surface if the first approximation point is not acceptable, and repeating this 
process until an acceptable approximation point is located for the inversion of the point in 
1 0 the distorted surface. 

According to another aspect of the invention, the use of this method to obtain the distance 
between points on an undistorted surface from the relative distances between 
corresponding points on a plurality of distorted surfaces in a detail-in-context 
presentation is described. 

15 According to another aspect of the invention, a data processing system is described. This 
data processing system has stored therein data representing sequences of instructions 
which when executed cause the above-described method to be performed. The data 
processing system generally has an input device, a central processing unit, memory 
device, and a display. 

20 Referring to FIG. 6, there is shown a block diagram of an exemplary data processing 
system 600 according to one embodiment of the invention. The data processing system is 
suitable for implementing EPS graphics technology. The data processing system 600 
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includes an input device 610, a central processing unit or CPU 620, memory 630, and a 
display 640. The input device 610 may be a keyboard, mouse, trackball, or similar 
device. The CPU 620 may include dedicated coprocessors and memory devices. The 
memory 630 may include RAM, ROM, databases, or disk devices. And, the display 640 
5 may include a computer screen or terminal device. The data processing system 600 has 
stored therein data representing sequences of instructions which when executed cause the 
method described herein to be performed. Of course, the data processing system 600 may 
contain additional software and hardware a description of which is not necessary for 
understanding the invention. 

10 Referring to FIGURES 1 through 7 the method of one embodiment of the invention will 
now be described. With this method, a point in an undistorted presentation or data space 
is found, which when distorted, yields a specified point in a distorted presentation or data 
space. Then, if desired, the inversion of the entire distorted presentation or data space to 
an original undistorted presentation or data space may be obtained as the inverse mapping 

15 of the locus of points in the distorted presentation or data space. The method is iterative 
and makes use of the distortion process itself as a component in an approximation 
technique for computing the inverse of the distortion. 

Referring to FIG. 1, there is shown a cross-sectional view of a presentation 100 in 
accordance with EPS graphics technology and in accordance with the preferred 
20 embodiment. EPS graphics technology employs viewer-aligned perspective projections to 
produce detail-in-context presentations in a reference view plane 101 which may be 
viewed on a display 640. Undistorted two-dimensional (2D) data points are located in a 
basal plane 110 of a three-dimensional (3D) perspective viewing volume 120 which is 
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defined by extreme rays 121 and 122 and the basal plane 110. A reference viewpoint 
(RVP) 140 is located above the centre point of the basal plane 110 and reference view 
plane 101. Points in the basal plane 110 are displaced upward onto a distorted surface 130 
which is defined by a general three-dimensional distortion function D. The direction of 
5 the viewer-aligned perspective projection corresponding to the distorted surface 130 is 
indicated by the line F 0 - F 131 drawn from a point F 0 132 in the basal plane 110 through 
the point F 133 which corresponds to the focus or focal region of the distorted surface 
130. The method of the present invention locates a point Pi in the basal plane 110 that 
corresponds to a point X 150 on the distorted surface 130 through a series of steps, 
1 0 involving iteration and approximation, as follows. Successive approximations of the point 
Pi are represented by the subscript i where i £0. 

Referring to FIG. 7, where there is shown a flow chart 700 illustrating the method of one 
embodiment of the invention, and again referring to FIG. 1, at step 1, an acceptable 
tolerance 8 is selected for the magnitude of the difference between the point X 150 on the 

1 5 distorted surface 130 and the point Pi D , where Pi D represents the result of the mapping of 
a point Pi in the basal plane 110 onto the distorted surface 130 through the function D. 
The value of 8 is application dependent. For example, an acceptable 8 could be less than 
half the width of a pixel for a typical display surface such as a monitor 640. In general, 
successive approximations of the point Pi will continue until the magnitude of the 

20 difference between the point X 150 and the point Pi D is less than 8, that is, until | Pj D - X | 
<8. 
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At step 2, a first approximation point P 0 160 for the inversion of X 150 is located at the 
intersection point in the basal plane 110 of a line RVP-X 170 drawn through RVP 140, X 
150, and the basal plane 110. Here, i = 0. 

Referring to FIG. 2, at step 3, point P 0 160 is displaced onto the distorted surface 130 by 
5 the application of D. The resultant point on the distorted surface 130 is represented by 
P 0 D 210. 

At step 4, the magnitude of the difference between the point X 150 and the point P 0 D 210 
is calculated. If | P G D - X | < 8, then an acceptable value for the inversion of the point X 
150 will have been found and the method is complete for the point X 150. The method 
1 0 may then proceed with the inversion of another point on the distorted surface 130. If | P 0 D 
- X | > 5, then the method will continue and will generate a next approximation for the 
inversion of the point X 150. 

Referring to FIG. 3, at step 5, the point P 0 D 210 is projected onto the line RVP-X 170 to 
locate the point P 0 P 310 which is the closest point to P 0 D 210 on the line RVP-X 170. 

15 Referring to FIG. 4, at step 6, the point P 0 P 310 is projected onto the basal plane 110 to 
produce the next approximation Pi 410 for the inversion of the point X 150. This 
projection is made in the direction parallel to a line F - F 0 , that is, in the direction from 
point F 133 to point F 0 132 parallel to the line F 0 - F 131. Alternately, this direction can 
also be established by applying the distortion function D to any point in the basal plane 

20 within the lens extent (as defined by the distortion function D). The direction of the 
displacement of such a point by the distortion function D will be antiparallel to the line 
F - F 0 . The point ?\ 410 is thus located on the basal plane 110 at the point of intersection 
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of the basal plane 110 and a line 420 drawn parallel to the line F 0 - F 131 and passing 
through the point P 0 P 310. Now, i = 1 and a second iteration may begin from step 3. 

Referring to FIG. 5, a second iteration is illustrated resulting in point P2 510 as an 
approximation of the inversion of the point X 150. 

5 Again referring to FIG. 1, in certain cases such as folding, which is the lateral 
displacement of a focal region 133 through shearing of the viewer-aligned vector defining 
the direction of distortion 131, it is possible for successive approximations for Pi to 
diverge. This may be caused, for example, by a fold in which a undistorted area of the 
basal plane 110 is hidden by a portion of the distorted surface when viewed from RVP 
10 140 such that a line drawn through RVP 140, the distorted surface, and the basal plane 
110 intersects the distorted surface at multiple points. In these circumstances, a bisection 
of approximation points Pi may be used to search for the desired intersection of RVP-X 
170 with the basal plane 110. 

The method of the embodiment of the invention described above may be used to obtain 
1 5 the distance between points on an undistorted surface from the relative distances between 
corresponding points on one or more distorted surfaces in a detail-in-context presentation. 
For example, if one point is selected on a first distorted surface and a second point is 
selected on a second distorted surface, both surfaces being contained in a detail-in- 
context presentation, then the distance between these two points on the undistorted 
20 surface may be found by first inverting each point on each distorted surface, using the 
method of the invention, to obtain corresponding points on the undistorted surface. Then, 
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the required distance may be calculated as the magnitude of the difference between the 
two inverted points. 

To reiterate and expand, the method and system of the present invention includes the 

5 following unique features and advantages: it facilitates the location of a point in an 
undistorted presentation which, when distorted, yields a specified point in a distorted 
presentation and then, from this point, the inversion of the entire distorted presentation 
back to the original undistorted presentation may be accomplished through the inverse 
mapping of the locus of the points in the distorted presentation; it employs an iterative 

10 approach to inversion to facilitate general distortion functions; in other words, having 
knowledge of the location of the point to be inverted in the distorted presentation and 
through an iterative process, it computes a series of points in the undistorted presentation 
space until a point is found, which when displaced by a general distortion function, yields 
a point that is coincident with the point to be inverted in the distorted presentation; it is 

15 not specific to a particular distortion function or transform equation; it does not require 
the maintenance of a copy of the undistorted presentation in computer memory; it does 
not use look-up tables and hence does not put unacceptable demands on computing 
system resources, including memory, especially for undistorted presentations that are 
large in size; and, it may be used to obtain the distance between points in an undistorted 

20 presentation from the relative distances between corresponding points on one or more 
distorted surfaces in a detail-in-context presentation. 
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Although the invention has been described with reference to certain specific 
embodiments, various modifications thereof will be apparent to those skilled in the art 
without departing from the spirit and scope of the invention as outlined in the claims 
appended hereto. 
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THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE 
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS: 

1. In a data processing system that executes a program of instructions, a method of 
inverting a distorted surface in a detail-in-context presentation comprising the steps 

of: 

a) locating a first approximation point Pi for the inversion of a point X; 

b) determining if said approximation point ? t is acceptable as an inversion of said 
point X; 

c) locating a next approximation point P*i for the inversion of said point X if said 
approximation point Pi is not acceptable as an inversion of said point X; 

d) repeating steps (b) and (c) until an acceptable point is located for the inversion of 
said point X. 

2. The method of claim 1 wherein said point X is a point on said distorted surface in 
said detail-in-context presentation whose inversion is sought 

3 . The method of claim 1 wherein said point Pi is a point on said undistorted surface and 
is the approximate inversion point of said point X. 

4. The method of claim 3 wherein said undistorted surface is included in said detail-in- 
context presentation. 
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5. The method of claim 1, step (a), and further comprising the step of drawing a line 
RVP-X from a point RVP above an undistorted surface in said detail-in-context 
presentation, through said point X, and through said undistorted surface to locate said 
first approximation point Pj at the point of intersection of said line RVP-X and said 
undistorted surface. 

6. The method of claim 5 wherein said point RVP is a reference viewpoint for said 
detail-in-context presentation. 

7. The method of claim 1, step (b), and further comprising the steps of: 

a) obtaining a point Pj D by displacing said point Pi onto said distorted surface by the 
application of a distortion function D; 

b) calculating the magnitude of the difference between said point X and said point 
Pi D , where said magnitude of the difference is given by | Pi D - X | ; 

c) deciding that an acceptable value of said point Pi for the inversion of said point X 
has been obtained if said magnitude of the difference is less than a tolerance 5. 

8. The method of claim 1 , step (c), and further comprising the steps of: 

a) projecting said point Pi D onto said line RVP-X to locate a point Pi P , where said 
point Pj P is the closest point to said point P{ D on said line RVP-X; 

b) projecting said point P, p onto said undistorted surface in a direction opposite to 
that of the displacement due to the distortion to locate said next approximation 
point Ph-i for the inversion of said point X, where said displacement due to 
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distortion is given by a line F 0 - F drawn through said undistorted surface and the 
focus F of said distorted surface, and hence where said point Pi+i is located on 
said undistorted surface at the point of intersection of said undistorted surface and 
a line drawn parallel to said line F G - F and passing through said point P*. 

9. The method of claim 1 and further comprising the step of bisecting said point Pi to 
counter divergence in successive approximations of said point Pi due to folds or 
discontinuities in said distorted surface. 

10. The method of claim 1 and further comprising the step of repeating steps (a) through 
(d) for additional or remaining points in said distorted surface. 

11. The method of claim 7 and further comprising the step of selecting a value for said 
tolerance 8. 

12. The method of claim 1 1 wherein said tolerance 5 is selected as a fraction of the width 
of a pixel for a computer display surface. 

13. The method of claim 12 wherein said fraction is one half. 

14. The method of claim 1 wherein said undistorted surface is a basal plane in accordance 
with Elastic Presentation Space graphics technology. 

15. The method of claim 7 wherein said distortion function D is used to generate said 
distorted surface. 

16. The method of claim 15 wherein said distortion function D is an n-dimensional 
function, where n is an integer greater than zero. 



17 



CA 02341965 2001-03-23 

17. The method of claim 16 wherein said distortion function D is a three-dimensional 
function. 

18. The method of claim 1 5 wherein said distortion function D is a lens function. 

19. The method of claim 1 wherein said detail-in-context presentation is generated in 
accordance with Elastic Presentation Space graphics technology. 

20. The use of the method of claim 1 to obtain the distance between points on said 
undistorted surface from the relative distances between corresponding points on a 
plurality of said distorted surfaces in said detail-in-context presentation. 

21. A data processing system for the inversion of detail-in-context presentations 
including an input device, a central processing unit, memory, and a display wherein 
said data processing system has stored therein data representing sequences of 
instructions which when executed cause the method and use of claims 1 through 20 to 
be performed. 
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